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(54) METHOD FOR DETECTING APPLIED STATE OF SEALANT 
(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a method for 
detecting applied state of sealant, by which the applied 
amount of a sealant can be judged from the length and 
cross-sectional area of the applied sealant, by 
estimating the cross-sectional area and the shape 
variation of the sealant can be measured precisely by 
easily setting windows correspondingly to the shape 
variation. 

SOLUTION: The method for detecting applied state of 
sealant includes a step of picking up the image of a 
prescribed area of a sealant linearly applied to a surface 
to be applied from right above, a step of temporarily 
polygonally approximating the border lines of the sealant 
on both sides in the image Qb picked up in the preceding 
step, a step of equally dividing the sealant in the picture 
Qb into a plurality of sealant parts based on the 
coordinates Ta, Tb,... of the edges of the polygonal lines, 
a step of setting the center coordinates of a plurality of 
windows Wa, Wb,... in which the divided sealant parts are 
respectively positioned at their centers from the coordinates Ta, Tb,.. 
the polygonal lines and, at the same time, detecting the applied states of the sealant parts, such 
as the widths, positions, etc., in the windows Wa, Wb,... set at the center coordinates. 




and a step of canceling 
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CLAIMS 



[Claim(s)] 

[Claim 1] The application state method of detection of a sealing compound characterized by 
providing the following. The process which picturizes the predetermined field of the sealing 
compound applied to the coated side at the line from right above. The process which carries 
out broken line approximation of the both-sides border line of the sealing compound of the 
picture acquired by the aforementioned image pck-up temporarily. The process which 
divides the sealing compound within a picture equally into two or more sealing-compound 
portions based on the coordinate of each edge of the aforementioned broken line within the 
aforementioned picture. The process which detects application states, such as width of face 
of the sealing-compound portion in each window set up with the aforementioned main 
coordinate, and a position, while canceling the process which sets up the main coordinate of 
two or more windows which locate each aforementioned sealing-compound portion in the 
center of a window, respectively, and the aforementioned broken line approximation of the 
coordinate of each edge of each aforementioned sealing-compound portion. 
[Claim 2] To the sealing compound of the predetermined field applied to the coated side at 
the line by irradiating lighting light from the right-and-left both-sides slanting upper part 
toward the longitudinal direction of the aforementioned sealing compound at a bilateral 
symmetry Shading corresponding to the cross-section configuration of the aforementioned 
sealing compound is formed on the aforementioned coated side of the both sides of the 
aforementioned sealing compound. Binary- -ization-process the aforementioned shading, 
form the pattern picture of a bright section and dark space, and it asks for the 
correspondence relation between the characteristic quantity on the aforementioned pattern 
picture, and the cross section of a sealing compound. The application state method of 
detection of the sealing compound according to claim 1 characterized by measuring the 
characteristic quantity of the measured pattern picture and calculating the cross section of 
the sealing compound of a predetermined field by the above-mentioned correspondence 
relation. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] this invention relates to the method of 
detecting the quality of the application state of the sealing compound applied to mating 
faces, such as an oil pan mechanism of transmission, at the line. 
[0002] 

[Description of the Prior Art] About an oil pan mechanism, extension housing, etc. of 
transmission, it attaches, and it attaches in one and there are mating faces and a process to 
seal among the production process of an automobile. In that case, as shown in drawing 4 (a) 
and (d) letter crevice of ups and downs (lc) {which covered the marginal part perimeter of 
the mating face (la) (2a) of an oil pan mechanism (l) and extension housing (2), avoided 
screwhole (lb) "(2b)" etc., and was formed " drawing 4 (b) " reference} " a 
sealing-compound {liquefied gasket 0 [ Formed ] In the mating faces (la) (2a) after applying 
Place Gasket} (3) ■• screw stop fixation is attached and carried out It is attached a mating 
face (la) (2a) crashing a sealing compound (3) by screw stop fixation, and filling a crevice 
(lc), if it does so, and seals without a crevice. In addition, the b"b line cross section of 
drawing 4 (a), the c section detail drawing, and drawing 4 (e) of drawing 4 (b) and (c) are the 
e section detail drawing of drawing 4 (d). 

[0003] When there are too many coverages of a sealing compound (3) at this time, when an 
excessive sealing compound (3) falls to an oil pan mechanism (l) and mixes in oil, oilway 
plugging is produced, since the portion into which the sealing compound (3) went out when 
too few on the contrary to this oil spillage is produced, it is necessary to detect an 
application state and an example of the detection means is shown below with reference to 
drawing 5 and drawing 6 . As for an image pck*up means of fixation, such as a CCD camera, 
by which (4) picturizes a work (5) from right above, the image processing system by which 
(6) was connected to the image pck _ up means (4), and (7), in drawing 5 , a lighting system 
and (8) are picture monitors. 

[0004] If the sealing-compound picture (Qa) which picturizes the sealing compound (3) 
applied to the oil pan mechanism etc., and is shown in drawing 6 (a) is acquired according 
to the above-mentioned composition, as shown in drawing 6 (b), the edge of a sealing 
compound (3) will be detected from the lightness difference (Ha) of the ligmVand-darkness 
section of the sealing-compound picture (Qa) in an inspection line (La). And a perimeter is 
covered, application width of face (Da), an application position, an application piece, etc. are 
detected, and a multiple -regression formula detects the quality of an application state. If all 
the pictures that the sealing-compound picture (Qa) picturized are collectively measured at 
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this time, the partial fine state of the sealing compound (3) reflected in one screen, a size, 
etc. are immeasurable. Then, if a sealing compound (3) is greatly picturized in order to 
measure finely, since the number of sheets of an image pck*up picture will increase, the 
processing time becomes long. 

[0005] Then, it is finely measurable, if the window set up beforehand is put on a 
sealing-compound picture (Qa), an image pck-up picture is divided and the picture in a 
window is measured. 
[0006] 

[Problem(s) to be Solved by the Invention] According to the above-mentioned detection 
means, since the application state is detected from the superficial image pck-up picture of a 
sealing compound (3), there is fault that it cannot detect to a three-dimensional 
cross-section thickness configuration, and the quality of a coverage cannot be detected. 
Moreover, when putting the set-up window on a sealing-compound picture (Qa) and 
measuring it finely, since the sealing compound (3) has bent, a setup of a window cannot 
respond to configuration change of the deflection of a sealing compound (3) etc., and the 
detection corresponding point of a sealing-compound picture (Qa) may be settled in a 
window, and may not go out. 

[0007] The purpose of this invention is offering the application state method of detection of 
the sealing compound which presumes the cross section of the applied sealing compound, 
and can judge a coverage with length and the cross section, and sets up a window easily 
corresponding to configuration change of a sealing compound, and can be measured finely. 
[0008] 

[Means for Solving the Problem] The process which picturizes the predetermined field of a 
sealing compound where this invention was applied to the coated side at the line from right 
above, The process which carries out broken line approximation of the both-sides border 
line of the sealing compound of the picture acquired by the aforementioned image pck-up 
temporarily, The process which divides the sealing compound within a picture equally into 
two or more sealing-compound portions based on the coordinate of each edge of the 
aforementioned broken line within the aforementioned picture, While canceling the process 
which sets up the main coordinate of two or more windows which locate each 
aforementioned sealing-compound portion in the center of a window, respectively, and the 
aforementioned broken line approximation of the coordinate of each edge of each 
aforementioned sealing-compound portion As opposed to the sealing compound of the 
predetermined field which was characterized by having the process which detects 
application states, such as width of face of the sealing-compound portion in each window set 
up with the aforementioned main coordinate, and a position, and was applied to the coated 
side at the line By irradiating lighting light from the right-and-left both-sides slanting 
upper part toward the longitudinal direction of the aforementioned sealing compound at a 
bilateral symmetry Shading corresponding to the cross- section configuration of the 



aforementioned sealing compound is formed on the aforementioned coated side of the both 
sides of the aforementioned sealing compound. Binary- izationprocess the aforementioned 
shading, form the pattern picture of a bright section and dark space, and it asks for the 
correspondence relation between the characteristic quantity on the aforementioned pattern 
picture, and the cross section of a sealing compound. It is characterized by measuring the 
characteristic quantity of the measured pattern picture and calculating the cross section of 
the sealing compound of a predetermined field by the above-mentioned correspondence 
relation. 
[0009] 

[Embodiments of the Invention] The gestalt of operation of the application state method of 
detection of the sealing compound concerning this invention is explained below with 
reference to drawing 1 - drawing 3 . First, drawing 1 shows the equipment for enforcing this 
invention method, and (10) includes a downward CCD camera and downward lighting in 
drawing. The image pck-up unit which picturizes the sealing compound (3) which was 
attached in the rectangular robot for movement (11), and was applied to the work (12), for 
example, an oil pan mechanism, from right above, The image processing system by which 
(13) was connected to the image pck-up unit (10), the personal computer by which (14) and 
(15) were connected to the image processing system (13) and a picture monitor, and (16) are 
the power supplies for lighting connected to the image pck-up unit (10) and the personal 
computer (14). 

[0010] Based on the above-mentioned composition, operation (method) of this invention is 
explained below. First, as shown in drawing 2 (a), lighting light is irradiated from the 
right-and-left both-sides slanting upper part toward the longitudinal direction of a sealing 
compound (3) at a bilateral symmetry at the linear sealing compound (3) applied to the oil 
pan mechanism by the in-a-circle lighting (Ua) of an image pck-up unit (10), and (Ub), and 
a sealing compound (3) is picturized from right above by the CCD camera (calcium) of an 
image pck-up unit (10). If it does so, shading corresponding to the cross-section thickness 
configuration of a sealing compound (3) will be formed on a coated side, and as shown in 
drawing 2 (b) - (f), pattern picture [ of the bright section of a predetermined configuration 
and dark space ] (Pb) - (Pf) will arise by shading. The pattern picture (Pb) - (Pf) changes 
according to a sealing compound (3b) - (30 a flat surface (width of face), and a cross-section 
(thickness) configuration, and becomes a thing reflecting the cross-section configuration. In 
addition, a pattern picture (Pb), (Pc), (Pd) and (Pe), and (Pf) are based on lighting (Ua) and 
(Ub), respectively. 

[0011] Next, if the sealing-compound picture (Qb) shown in drawing 3 (a) by making the 
outermost edge (Mb) of the right-and-left dark space of * (Pf), pattern picture (Pb) (Nb) - 
(Mf), and (Nf) into a profile is acquired, as shown in drawing 3 (b), the profile (Mb) of 
drawing 2 , (Nb) - (Mf), and (Nf) will be temporarily approximation-ized on a broken line 
(Lb). And the main coordinate of reference} is set up for the broken line (two or more 



window (Wa) -(We) { drawing 3 (c which the sealing compound within a picture (Qb) is 
equally divided [ c ] into two or more sealing-compound portions based on the coordinate of 
each edge of Lb), and locates each above-mentioned sealing-compound portion in the center 
of a window from the coordinate of each above-mentioned edge, respectively) within a 
picture (Qb). 

[0012] For example, each edge coordinate (Ta) of the profile of the longer one and (Tb) - are 
measured, and the distance between edges is measured along with a profile. And supposing 
the mid-position (A) between (Tb) - (Td) is between (Tc) - (Td) exceeding the set point 
between (Tb) - (Td) when the measured distance between edges exceeds the set point for 
example Window (Wa) - (We) is set up for the point (Z) that the perpendicular (B) of 
straight-line (Tc) - (Td) passing through the mid-position (A) crosses the center of the cross 
direction of a sealing compound, as a center of a window. In addition, the center of the cross 
direction of a sealing compound is the mid-position of the cross direction between the 
outermost edge (Mb) of the right-and-left dark space of - (Pf), - between pattern picture (Pb) 
(Nb(s)) by the above-mentioned shading (Mf), and (Nf). 

[0013] And as shown in drawing 3 (c), a sealing-compound picture (Qb) is covered, making 
an adjoining edge lengthwise [ the ] (X) two or more window (Wa) - (We) overlap for every 
main coordinate. If it does so, a sealing-compound picture (Qb) will be altogether settled in 
window (Wa) - (We), and, moreover, the length of the sealing-compound portion in each 
window will become abbreviation homogeneity. 

[0014] Then, as shown in drawing 2 (b) - (f), pattern picture (Pb) - (Pf) is 
binary-ization-processed, and the position of a bright section or dark space, area, and a 
number are measured at once for every window from the binary-ized picture of pattern 
picture (Pb) - (P£). The measurement data changes according to the width of face and the 
cross-section configuration of a sealing compound (3) as mentioned above, and reflects a 
cross-section configuration. For example, at the time of irradiation of lighting (Ua), as 
shown in drawing 2 (b), when a sealing-compound (3b) cross section is circular, a 
sealing-compound crowning becomes the brightest, and the contiguity section becomes dark 
and acquires a pattern picture (Pb). moreover, the case where a sealing-compound (3c) cross 
section is an oblong ellipse as shown in drawing 2 (c) - the bright section of a 
sealing-compound crowning -- the time of cross-section circular -- broad — becoming - a 
pattern picture (Pc) — obtaining - further ■■ a cross section - a bright section becomes broad, 
so that it becomes flat Moreover, as shown in drawing 2 (d), when a sealing-compound (3d) 
upper surface center section is dented a little and two crownings arise, two bright sections 
arise and a pattern picture (Pd) is acquired. Similarly, according to a round shape and each 
sealing-compound (3e) (30 cross section of a semicircle, a pattern picture (Pe) and (PC are 
obtained, respectively at the time of irradiation of lighting (Ub). Therefore, the 
sealing-compound cross section can be presumed from pattern picture (Pa) - (Pf). 
[0015] The coverage (volume) of a sealing compound (3) can be computed by on the other 



hand multiplying the length which met the profile of pattern picture (Pb) - in a window (Pf) 
by the above-mentioned cross section. 

[0016] Then, it asks for the correspondence relation between the characteristic quantity on 
the picture of the pattern picture of the light and darkness which appear according to the 
sealing-compound cross section beforehand (for example, the width of face of a bright 
section, area and the width of face of dark space, and area), and the cross section of a 
sealing compound. For example, it asks for the multiple -regression formula which makes 
the purpose variable the cross section of an explanation variable and a sealing compound 
for the above-mentioned characteristic quantity beforehand. And the characteristic 
quantity for every window of the measured light-and-darkness pattern picture is measured, 
and the cross section of a sealing compound is calculated from the above-mentioned 
multiple-regression formula. Furthermore, a coverage (volume) is computed by multiplying 
this cross section by the length of the sealing compound on a picture. 

[0017] Or the cross section, the length, and the amount according to the light-and-darkness 
pattern are created as standard data, matching contrast of the pattern picture and 
standard -pattern picture of light and darkness which were measured is carried out, a 
sealing-compound flat surface (length) and a cross-section configuration (cross section) are 
presumed for every window, and a sealing-compound coverage is detected. Although the flat 
surface and cross-section configuration of a sealing compound which were applied are 
various at this time, it is substantially restricted to a certain limited number of kinds, and 
since the kind of appearing configuration is restricted, the number of standard data which 
should be prepared also falls within a certain range. What is necessary is just to resemble 
the nearest standard data, supposing there are no standard data which are correctly in 
agreement in the measured light-and-darkness pattern picture. 

[0018] In addition, in the determination of this nearest standard data, fuzzy reasoning is 

applicable. 

[0019] 

[Effect of the Invention] In detecting the application state of the sealing compound applied 
on coated sides, such as a mating face of an oil pan mechanism, according to this invention 
Shading which irradiated lighting light from the slanting upper part at the bilateral 
symmetry, and reflected the cross-section configuration in the sealing compound is formed 
on a coated side. And picturize a sealing compound from right above and the border line of a 
sealing-compound picture is temporarily formed into broken line approximation. Based on 
the coordinate of the edge of the above-mentioned broken line, a sealing compound is 
equally divided into two or more sealing-compound portions. The main coordinate of two or 
more windows which locate a sealing-compound portion in the center of a window from the 
coordinate of the above-mentioned edge is set up. Binary--ization~process shading of a 
predetermined configuration which changes according to the flat surface and cross-section 
configuration of a sealing compound for every window, and the pattern picture of a bright 
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section and dark space is formed. It asks for the correspondence relation between the 
characteristic quantity of the above-mentioned pattern picture, and the cross section of a 
sealing compound. Since the characteristic quantity for every window of the measured 
pattern picture was measured and the cross section of a sealing compound was calculated 
by the above-mentioned correspondence relation, the sealing-compound cross section can be 
presumed, a coverage can be detected by the length of a sealing compound, and generating 
of oilway plugging etc. can be prevented. Moreover, when measuring finely, a sealing 
compound can set up a window easily according to a sealing-compound configuration in any 
configurations, and the processing time is shortened. 
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